LU factorization with panel rank revealing pivoting and its communication avoiding version

نویسندگان

  • Amal Khabou
  • James Demmel
  • Laura Grigori
  • Ming Gu
چکیده

We present the LU decomposition with panel rank revealing pivoting (LU PRRP), an LU factorization algorithm based on strong rank revealing QR panel factorization. LU PRRP is more stable than Gaussian elimination with partial pivoting (GEPP), with a theoretical upper bound of the growth factor of (1+ τb) n b , where b is the size of the panel used during the block factorization, τ is a parameter of the strong rank revealing QR factorization, and n is the number of columns of the matrix. For example, if the size of the panel is b = 64, and τ = 2, then (1+2b) = (1.079) 2n−1, where 2n−1 is the upper bound of the growth factor of GEPP. Our extensive numerical experiments show that the new factorization scheme is as numerically stable as GEPP in practice, but it is more resistant to pathological cases and easily solves the Wilkinson matrix and the Foster matrix. The LU PRRP factorization does only O(nb) additional floating point operations compared to GEPP. We also present CALU PRRP, a communication avoiding version of LU PRRP that minimizes communication. CALU PRRP is based on tournament pivoting, with the selection of the pivots at each step of the tournament being performed via strong rank revealing QR factorization. CALU PRRP is more stable than CALU, the communication avoiding version of GEPP, with a theoretical upper bound of the growth factor of (1 + τb) n b (H+1)−1, where b is the size of the panel used during the factorization, τ is a parameter of the strong rank revealing QR factorization, n is the number of columns of the matrix, and H is the height of the reduction tree used during tournament pivoting. The upper bound of the growth factor of CALU is 2n(H+1)−1. CALU PRRP is also more stable in practice and is resistant to pathological cases on which GEPP and CALU fail. Key-words: LU factorization, numerical stability, communication avoiding, strong rank revealing QR factorization LU PRRP and CALU PRRP 3

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Calculs pour les matrices denses : coût de communication et stabilité numérique. (Dense matrix computations : communication cost and numerical stability)

This dissertation focuses on a widely used linear algebra kernel to solve linear systems, that is the LU decomposition. Usually, to perform such a computation one uses the Gaussian elimination with partial pivoting (GEPP). The backward stability of GEPP depends on a quantity which is referred to as the growth factor, it is known that in general GEPP leads to modest element growth in practice. H...

متن کامل

Communication Avoiding Rank Revealing QR Factorization with Column Pivoting

In this paper we introduce CARRQR, a communication avoiding rank revealing QRfactorization with tournament pivoting. We show that CARRQR reveals the numerical rank of amatrix in an analogous way to QR factorization with column pivoting (QRCP). Although the upperbound of a quantity involved in the characterization of a rank revealing factorization is worse forCARRQR than for QRCP...

متن کامل

A Class of Communication-avoiding Algorithms for Solving General Dense Linear Systems on CPU/GPU Parallel Machines

We study several solvers for the solution of general linear systems where the main objective is to reduce the communication overhead due to pivoting. We first describe two existing algorithms for the LU factorization on hybrid CPU/GPU architectures. The first one is based on partial pivoting and the second uses a random preconditioning of the original matrix to avoid pivoting. Then we introduce...

متن کامل

Strong Rank Revealing Cholesky Factorization

STRONG RANK REVEALING CHOLESKY FACTORIZATION M. GU AND L. MIRANIAN y Abstract. For any symmetric positive definite n nmatrixAwe introduce a definition of strong rank revealing Cholesky (RRCh) factorization similar to the notion of strong rank revealing QR factorization developed in the joint work of Gu and Eisenstat. There are certain key properties attached to strong RRCh factorization, the im...

متن کامل

Exploiting Fine-Grain Parallelism in Recursive LU Factorization

The LU factorization is an important numerical algorithm for solving system of linear equations in science and engineering and is characteristic of many dense linear algebra computations. It has even become the de facto numerical algorithm implemented within the LINPACK benchmark to rank the most powerful supercomputers in the world, collected in the TOP500 website. In this context, the challen...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • SIAM J. Matrix Analysis Applications

دوره 34  شماره 

صفحات  -

تاریخ انتشار 2013